SUPPORT / SAMPLES & SAS NOTES
 

Support

Problem Note 67986: A "NoSuchMethodError" message appears when you access SAS® SPDE data sets through Hive in Cloudera Hadoop 7.1

DetailsHotfixAboutRate It

When you access SAS® Scalable Performance Data Engine (SPDE) data sets through Apache Hive in Cloudera Hadoop 7.1, a “NoSuchMethodError” message might occur. 

Here is an example of the error message:

ERROR : Vertex failed, vertexName=Map 1, vertexId=vertex_1612553652178_0007_1_00, diagnostics=[Vertex vertex_1612553652178_0007_1_00 [Map 1] killed/failed due to:ROOT_INPUT_INIT_FAILURE, Vertex Input: misc11 initializer failed, vertex=vertex_1612553652178_0007_1_00 [Map 1], java.lang.NoSuchMethodError: org.apache.hadoop.hive.ql.plan.MapWork.getPathToPartitionInfo()Ljava/util/LinkedHashMap;
at com.sas.hadoop.serde.spde.hive.SPDInputFormat.setObsLength(SPDInputFormat.java:92)
at com.sas.hadoop.serde.spde.hive.SPDInputFormat.getSplits(SPDInputFormat.java:65)
at org.apache.hadoop.hive.ql.io.HiveInputFormat.addSplitsForGroup(HiveInputFormat.java:541)
at org.apache.hadoop.hive.ql.io.HiveInputFormat.getSplits(HiveInputFormat.java:830)
at org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.initialize(HiveSplitGenerator.java:249)
at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:280)
at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:271)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1876)
at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:271)
at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:255)
at com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:69)
at com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
]

This error occurs because of a change that was made to the getPathToPartitionInfo() Hive function in Cloudera Hadoop 7. 

Click the Hot Fix tab in this note to access the hot fix for this issue.



Operating System and Release Information

Product FamilyProductSystemProduct ReleaseSAS Release
ReportedFixed*ReportedFixed*
SAS SystemBase SASz/OS9.4_M79.4_M79.4 TS1M79.4 TS1M7
z/OS 64-bit9.4_M79.4_M79.4 TS1M79.4 TS1M7
Microsoft® Windows® for x649.4_M79.4_M79.4 TS1M79.4 TS1M7
Microsoft Windows 8 Enterprise 32-bit9.4_M79.4_M79.4 TS1M79.4 TS1M7
Microsoft Windows 8 Enterprise x649.4_M79.4_M79.4 TS1M79.4 TS1M7
Microsoft Windows 8 Pro 32-bit9.4_M79.4_M79.4 TS1M79.4 TS1M7
Microsoft Windows 8 Pro x649.4_M79.4_M79.4 TS1M79.4 TS1M7
Microsoft Windows 8.1 Enterprise 32-bit9.4_M79.4_M79.4 TS1M79.4 TS1M7
Microsoft Windows 8.1 Enterprise x649.4_M79.4_M79.4 TS1M79.4 TS1M7
Microsoft Windows 8.1 Pro 32-bit9.4_M79.4_M79.4 TS1M79.4 TS1M7
Microsoft Windows 8.1 Pro x649.4_M79.4_M79.4 TS1M79.4 TS1M7
Microsoft Windows 109.4_M79.4_M79.4 TS1M79.4 TS1M7
Microsoft Windows Server 20089.4_M79.4_M79.4 TS1M79.4 TS1M7
Microsoft Windows Server 2008 R29.4_M79.4_M79.4 TS1M79.4 TS1M7
Microsoft Windows Server 2008 for x649.4_M79.4_M79.4 TS1M79.4 TS1M7
Microsoft Windows Server 2012 Datacenter9.4_M79.4_M79.4 TS1M79.4 TS1M7
Microsoft Windows Server 2012 R2 Datacenter9.4_M79.4_M79.4 TS1M79.4 TS1M7
Microsoft Windows Server 2012 R2 Std9.4_M79.4_M79.4 TS1M79.4 TS1M7
Microsoft Windows Server 2012 Std9.4_M79.4_M79.4 TS1M79.4 TS1M7
Microsoft Windows Server 20169.4_M79.4_M79.4 TS1M79.4 TS1M7
Microsoft Windows Server 20199.4_M79.4_M79.4 TS1M79.4 TS1M7
Windows 7 Enterprise 32 bit9.4_M79.4_M79.4 TS1M79.4 TS1M7
Windows 7 Enterprise x649.4_M79.4_M79.4 TS1M79.4 TS1M7
Windows 7 Home Premium 32 bit9.4_M79.4_M79.4 TS1M79.4 TS1M7
Windows 7 Home Premium x649.4_M79.4_M79.4 TS1M79.4 TS1M7
Windows 7 Professional 32 bit9.4_M79.4_M79.4 TS1M79.4 TS1M7
Windows 7 Professional x649.4_M79.4_M79.4 TS1M79.4 TS1M7
Windows 7 Ultimate 32 bit9.4_M79.4_M79.4 TS1M79.4 TS1M7
Windows 7 Ultimate x649.4_M79.4_M79.4 TS1M79.4 TS1M7
64-bit Enabled AIX9.4_M79.4_M79.4 TS1M79.4 TS1M7
64-bit Enabled Solaris9.4_M79.4_M79.4 TS1M79.4 TS1M7
HP-UX IPF9.4_M79.4_M79.4 TS1M79.4 TS1M7
Linux for x649.4_M79.4_M79.4 TS1M79.4 TS1M7
Solaris for x649.4_M79.4_M79.4 TS1M79.4 TS1M7
* For software releases that are not yet generally available, the Fixed Release is the software release in which the problem is planned to be fixed.